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PREFACE 


The  work  reported  herein  was  performed  in  part  under  AFOSR 
Contract  No.  F44620-75-C-0060 . Technical  Monitors  for  the  Air 
Force  were  Lt.  Col.  William  Wisecup  and  Lt.  Col.  Dominic  Maio 
of  the  Air  Force  Office  of  Scientific  Research. 

This  Interim  Scientific  Report  summarizes  the  work  per- 
formed by  Bolt  BeraneK  and  Newman  Inc.  during  the  second  year  of 
a joint  study  conducted  in  conjunction  with  the  Aerospace  Medical 
Research  Laboratory  (AMRL)  under  AFOSR  Contract  No.  F44620-75-C-0060 . 
The  results  of  the  first-year  effort  have  been  documented  by 
Levison,  Baron,  and  Junker  [1]. 
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1.  INTRODUCTION 


Two  tasks  were  performed  in  the  preceding  study  phase:  (1) 

the  "optimal  control"  pilot/vehicle  model  was  modified  to  provide 
an  alternative  treatment  of  motor-related  sources  of  pilot  random- 
ness, and  (2)  the  revised  model  was  used  to  analyze  the  pilot's 
use  of  motion  cues  in  a series  of  roll-axis  tracking  experiments. 

A simple  informational  treatment  of  motion  cues  provided  a con- 
sistent explanation  of  the  performance  differences  between  the 
motion  and  no-motion  conditions  explored  in  the  study. 

The  effects  of  motion  cues  found  in  the  first-year 
study  differed  qualitatively  from  those  reported  by  earlier 
investigators.  Therefore,  a second  set  of  experiments  was  per- 
formed to  resolve  these  apparent  discrepancies;  the  results  of 
these  experiments  are  the  major  topic  of  this  report. 

The  results  of  the  first-year  study  effort  under  this 
contract  are  reviewed  in  the  following  section,  and  some  addi- 
tional model  results  are  presented.  Section  3 contains  a descrip- 
tion of  the  experiments  conducted  in  the  second-year  effort;  the 
results  of  primary  data  reduction  and  model  analysis  are  presented 
in  Section  4.  Section  5 summarizes  the  results  of  this  effort. 

Appendix  A provides  supplementary  information  relating  to 
data  analysis.  Detailed  experimental  results  not  presented  in 
the  main  text  are  tabulated  in  Appendix  B,  and  Appendix  C contains 
certain  details  related  to  problem  formulation  for  model  analysis. 

The  reader  is  assumed  to  be  familiar  with  the  information 
contained  in  the  preceding  Interim  Report  (1).  Readers  not 
familiar  with  the  optimal-control  pilot/vehicle  model  employed 
in  this  study  are  referred  to  the  preceding  report  for  an  illustra- 
tion of  model  application  and  to  the  references  contained  in  that 
report  for  additional  details  on  model  theory  and  application. 
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2.  BACKGROUND 


Results  of  the  preceding  study  phase  are  described  below, 
and  some  additional  analysis  of  the  data  obtained  in  that  study 
is  presented. 

2.1  Review  of  the  Preceding  Study 

2.1.1  Model  Revisions 

Modifications  to  the  pilot  model  consisted  of  a revised 
treatment  of  motor-related  sources  of  pilot  randomness  (or 
"remnant").  Specifically,  (1)  motor  noise  was  treated  as  a 
wide-band  process  added  to  control  rate,  rather  than  to  commanded 
control  as  had  been  done  previously,  and  (2)  the  concept  of 
"pseudo"  motor  noise  was  introduced  to  allow  a differentiation 
between  the  actual  noise  driving  the  system  ("driving"  motor 
noise)  and  the  pilot's  internal  model  of  this  noise  (the  "pseudo" 
noise).  No  modifications  were  made  to  the  model  structure 
specifically  to  treat  the  pilot's  use  of  motion  cues. 

Adding  motor  noise  to  control  rate  allowed  the  model  to 
reproduce  the  low-frequency  "phase-droop"  exhibited  by  most 
pilot  describing  functions.  Although  tracking  performance  is 
generally  little  affected  by  low-frequency  phase  response,  it 
was  necessary  to  obtain  an  accurate  model  of  this  asoect  of 
controller  behavior  because  of  the  importance  of  low-frequency 
phase  characteristics  on  performance  in  the  AMRL/BBN  roll-axis 
tracking  study.  By  introducing  the  concept  of  pseudo  motor 
noise,  we  gained  added  flexibility  in  representing  pilot 
uncertainties  about  his  own  control  behavior  and  about  vehicle 
response.  The  mathematical  implications  of  this  model  revision. 
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as  well  as  applications  of  the  revised  model  to  previous  labora- 
tory tracking  results,  are  documented  in  Levison,  Baron,  and 
Junker  [ 1 ] . 

2.2.1  Analysis  of  Motion  Cues 

An  experimentax  and  analytical  study  was  performed  jointly 
by  AMRL  and  BBN . Experiments  were  performed  at  AMRL.  Primary  data 
reduction  was  performed  by  the  Air  Force;  statistical  analysis  and 
modeling  were  performed  by  Bolt  Beranek  and  Newman  Inc.  (BBN) . 

The  results  of  this  study  are  documented  in  Levison,  Baron,  and 
Junker  [1]  and  Levison  [2] . 

This  study  was  concerned  with  the  use  of  motion-related 
sensory  information  for  continuous  flight  control.  Other  potential 
effects  of  motion,  such  as  providing  alerting  cues  to  the  pilot  or 
providing  "realism"  to  aircraft  simulations,  v/ere  not  considered. 
Analysis  of  the  experimental  results  was  directed  towards 
developing  a generalized  description  of  the  manner  in  which  the 
pilot  uses  motion  cues,  with  the  ultimate  goal  of  providing  a 
model  that  can  predict  the  effects  of  motion  cues  on  system  per- 
formance in  a variety  of  control  situations. 

The  revised  pilot  model  was  used  as  the  basis  for  modeling 
the  use  of  motion  cues.  Model  analysis  was  directed  towards 
finding  the  most  straightforward  set  of  rules  for  adjusting 
pilot-related  parameters  that  would  reliably  account  for  the 
effects  of  motion  cues  on  pilot  response  and  total  system 
performance . 


7 


The  principal  results  of  this  study  were  as  follows: 

1.  The  effects  of  motion  cues  on  roll-axis  tracking 
performance  were  modeled  primarily  by  (a)  inclusion 
of  sensory  variables  that  are  likely  to  be  provided 
by  motion  sensors  (position,  rate,  and  acceleration 
of  the  controlled  vehicle  in  these  experiments) , 
and  (b)  an  increment  of  0.05  seconds  to  the  pilot 
time  delay.  Modeling  of  dynamics  associated  wJ Ih 
motion  sensing  was  not  required. 

2.  The  experimental  results  did  not  allow  us  to  determine 
whether  motion  and  visual  cues  were  processed  in 
parallel  without  interference,  or  whether  the  pilot 
had  to  "share  attention"  between  modalities.  Further- 
more, we  were  unable  to  determine  whether  the  pilot 
obtained  only  rate  cues  from  his  motion  sensors,  or 
whether  he  used  a combination  of  position,  rate,  and 
acceleration  cues. 

3.  Tracking  performance  was  consistent  with  the  notion  that 
attention  was  shared  optimally.  Moreover,  model  analysis 
indicated  that  optimal  allocation  of  attention  between 
visual  and  motion  cues  was  different  for  the  two  control 
tasks  explored  in  the  AMRL  study. 

4.  Although  tracking  error  was  not  greatly  affected  by 
the  selection  of  a relative  performance  penalty  on 
control-rate  activity,  a good  match  to  control  scores 
required  readjustment  of  this  penalty  for  the  two 
plants  explored  in  the  study;  furthermore,  different 
weightings  were  found  for  motion  and  static  tracking 
for  the  more  difficult  plant. 
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5. 


The  results  of  the  AMRL  study  differed  in  certain 
respects  from  earlier  studies  of  motion-based 
tracking.  In  the  AMRL  study,  availability  of 
motion  cues  resulted  in  an  increase  of  low-frequency 
phase  lead,  an  increase  in  high-frequency  phase  lag, 
and  no  important  change  in  gain-crossover  frequency; 
whereas  earlier  studies  have  shown  that  motion  has 
little  effect  on  low-frequency  phase  lead,  reduces 
high-frequency  phase  lag,  and  allows  an  increase  in 
gain-crossover  frequency. 

6.  Although  motion  cues  did  not  enhance  tracking  per- 
formance for  the  less  difficult  plant  explored  in 
the  AMRL  study,  model  analysis  predicts  that  motion 
will  enhance  task  performance  if  the  pilot  is  required 
to  allocate  a substantial  fraction  of  his  attention  to 
another  task.  That  is,  the  less  attention  paid  to  the 
tracking  task,  the  greater  should  be  the  relative 
benefit  of  motion  cues. 

2.2  Further  Analysis 

2.2.1  Effects  of  Motion  Sensor  Dynamics 

One  of  the  questions  raised  by  the  preceding  study  was 
whether  or  not  an  adequate  match  could  be  obtained  to  the  AMRL/BBN 
results  using  existing  models  for  vestibular  motion  sensors.  If 
an  adequate  match  could  not  be  obtained,  we  would  have  to  conclude 
that  either  (1)  existing  models  for  vestibular  sensors  were 
inadequate,  or  (2)  that  non-vestibular  motion  cues  were  important. 
If,  on  the  other  hand,  a superior  match  could  be  obtained,  we 
would  establish  the  necessity  for  including  sensor  submodels  in 
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the  overall  pilot/vehicle  model.  Finally,  if  inclusion  of 
vestibular  models  did  not  significantly  affect  the  matching 
capability  of  the  model,  we  would  simply  conclude  that  such 
models  were  not  required  for  modeling  pilot  performance  in 
tasks  of  the  sort  explored  in  the  experimental  study. 


The  following  models  were  included  in  the  pilot/vehicle 
representation  to  account  for  the  dynamical  response  properties 
of  vestibular  motion  sensors.  Response  characteristics  for  the 
semicircular  canals,  obtained  from  Peters  [3],  was 

y _ 10  ' II 

s (s  + 0.1)(s  + 10)“^ 

where  y^  is  the  sensation  provided  to  the  pilot  by  the  semi- 
circular canals,  and  is  rotational  acceleration.  Response 
characteristics  of  the  otolith,  obtained  from  Young  [4], 
were  assumed  to  be 


Y 

o 


1.5(s  + 0.076) 

(s  + 0.19)  (s  + 1.5) 


(2) 


where  y^  is  the  sensation  provided  by  the  utricles  and  SF  is 
the  motion  input  considered  as  a specific  force.  Since  the 
subject's  head  was  located  approximately  on  the  axis  of  rotation 
of  the  simulator,  translational  acceleration  of  the  head  was 
assumed  to  be  negligible,  and  the  major  input  was  assumed  to 
be  tilt.  Therefore,  the  effective  input  to  the  otoliths  was 
assumed  to  be  roll  angle. 


The  results  of  "Task  2"  — the  more  difficult  of  the  two 
tasks  explored  in  the  AMRL/BBN  study  — were  reanalyzed.  The 
basic  pilot  model  was  augmented  by  inclusion  of  these  dynamics 
in  the  description  of  system  response  behavior,  and  the 
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"display  vector"  consisted  of  four  quantities:  roll  angle  and 

roll  angle  rate,  obtained  visually,  and  the  quantities  y^  and  y^ 
provided  by  the  motion  sensors. 

Pilot  parameters  of  control-rate  weighting,  pseudo  motor 
noise/signal  ratio,  and  observation  noise/signal  ratio  were 
selected  as  shown  in  Table  1 of  Levison,  Baron  and  Junker  for 
the  Task  2 motion  experiment.  Time  delay  was  treated  as  a 
variable  of  the  analysis,  and  "attention"  to  the  various  per- 
ceptual quantities  was  manipulated  according  to  the  hypotheses 
of  (1)  interference  between  motion  and  visual  perceptions,  and 
(2)  no  interference.  Model-matching  scores  along  various 
dimensions  were  computed  as  defined  in  [1]. 

As  in  the  preceding  analysis,  no  single  set  of  pilot  para- 
meters provided  the  best  match  along  all  measurement  dimensions. 
That  is.  one  set  of  parameters  provided  the  best  overall  match 
to  rms  performance  scores,  another  to  the  pilot  describing 
function,  etc.  A good  match  — one  comparable  to  that  obtained 
in  the  preceding  study  — was  obtained  with  a time  delay  of  0.22 
seconds  and  an  attentional  split  of  60%  to  visual  cues  and  40% 
to  motion  cues.  (Analysis  with  the  non-dynamical  model  for  motion 
cues  yielded  a time  delay  of  0.25  seconds  and  70%-30%  attention 
split. ) 


As  shown  in  Figures  1 and  2,  the  mt del  including  the  motion 
sensor  dynamics  provided  predictions  nearly  identical  to  those 
provided  by  the  simple  informational  model  that  did  not  include 
such  dynamics.  We  therefore  conclude  that,  while  models  of 
vestibular  dynamics  are  consistent  with  the  results  obtained 
experimentally,  model  accuracy  is  not  enhanced  by  the  considera- 
tion of  such  models.  For  the  type  of  tasks  explored  in  the  AMRL/BBN 
study,  a simple  informational  analysis  appears  to  be  adequate. 
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Figure  1.  Effect' of  Sensor  Dynamics  on  Predicted  Rms 
Performance  Scores 


It  also  appears  that  the  increased  phase  lag  associated 
with  motion  simulation  cannot  be  accounted  for  entirely  by 
bandwidth  limitations  imposed  by  sensor  dynam.ics.  Additional 
delay  must  be  postulated  to  provide  the  best  match  to  high- 
frequency  phase  response.  This  delay  may  be  inherent  in  motion 
sensing  (Young  [4]),  for  example,  includes  a delay  of  0.3  seconds 
in  his  model  for  the  semicircular  canal  sensor),  or  it  may  reflect 
other  sources  of  performance  degradation  similar  to  that  observed 
when  pilots  are  subjected  to  high-frequency  vibration  [5,  6]. 

One  should  be  careful  not  to  make  the  general  conclusion 
that  sensor  dynamics  can  be  ignored.  The  recent  experiment 
performed  at  AMRL  employed  steady-state  tracking  tasks  for  which 
response  power  was  concentrated  mainly  in  the  region  of  the  band- 
pass of  the  semicircular  canals  (if  we  consider  the  canals  as 
rate  sensors).  For  transient  maneuvers  where  very  low  frequency 
response  characteristics  are  important,  sensor  dynamics  may  have 
to  be  considered.  This  is  particularly  true  for  situations  in 
which  the  low-frequency  washout  characteristics  of  the  sensors 
may  induce  illusions  [3].* 

2.2.2  Apparent  Discre,.  ancies  in  Motion-Cue  Utilization 

The  experimental  results  presented  here  appear  to  conflict 
with  the  findings  of  others  regarding  the  effects  of  motion  cues 
on  tracking  performance.  Both  Shirley  [7]  and  Stapleford  et  al.  [8] 
concluded  that  the  addition  of  motion  cues  allowed  the  pilot  to 


*The  model  for  semicircular  canals  proposed  by  Young  contains 
a washout  having  response  times  of  16  and  33  seconds.  These 
modes  would  not  be  important  in  the  type  of  steady-state 
tracking  task  explored  by  AMRL,  but  could  be  of  some  consequence 
in  certain  transient  maneuvers. 
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generate  greater  lead  at  high  frequencies,  thereby  permitting 
an  increase  in  gain-crossover  frequency.  Furthermore,  Shirley 
concluded  that  motion  cues  were  relatively  more  beneficial  for 
tracking  tasks  involving  low-order  plants  than  for  those 
involving  high-order  dynamics.  On  the  contrary,  the  results 
presented  above  show  that  motion  cues  resulted  in  more  high- 
frequency  phase  lag  (rather  than  lead),  no  appreciable  change 
in  gain  crossover,  and  greater  relative  improvement  with  the 
higher-order  plant. 

These  apparent  contradictions  do  not  necessarily  indicate 
that  the  AMRL  experimental  subjects  used  motion  cues  in  a manner 
different  from  the  subjects  who  participated  in  the  studies  of 
Shirley  and  of  Stapleford  et  al.  There  were  some  important 
differences  between  the  AMRL  experiments  and  the  earlier  studies. 
Both  Shirley  and  Stapleford  et  al . applied  the  input  disturbance 
in  such  a manner  that  both  the  visual  display  and  the  motion 
simulator  were  driven  by  the  input.  (That  is,  the  input  was 
applied  essentially  in  parallel  with  the  pilot's  control.)  In 
the  AMRL  study,  the  external  input  was  applied  as  a command 
signal;  only  the  pilot's  control  signal  drove  the  controlled 
plant.  Thus,  in  the  latter  study,  motion  cues  provided  some 
inner-loop  information  that  was  not  directly  obtained  from  the 
visual  cues.  In  addition,  the  dynamics  used  in  Task  2 of  the 
AMRL/BBN  study  were  higher  order  than  those  explored  in  the 
previous  studies. 

In  order  to  resolve  the  apparent  discrepancies  between 
the  AMRL/BBN  study  and  earlier  investigations,  we  attempted  to 
apply  the  model  described  above  to  relevant  data  available  in 
the  literature.  After  a brief  review  of  the  literature,  however, 
we  concluded  that  the  existing  data  base  was  unsuitable  for  a 
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definitive  test  of  the  model.  Specifically,  we  were  unable  to 
locate  a study  for  which  all  of  the  foliowinq  criteria  were  met: 

Complete  description  of  the  task.  In  order  to  properly 
model  the  control  task,  we  must  know  not  only  the  vehicle 
dynamics  and  input  characteristics  (which  are  usually  reported) , 
but  also  display  gain  and  stick  force/displacement  character- 
istics (which  are  often  omitted) . Knowledge  of  gain  is  needed 
so  that  we  can  model  the  effects  (if  any)  of  visual  resolution 
limitations.  Control-stick  characteristics  must  be  known  so 
that  high-frequency  pilot  response  behavior  can  be  properly 
modeled . 

Complete  description  of  response  behavior . Published 
results  usually  include  mean-squared  error  and  sometimes  pilot 
(or  combined  man-machine)  describing  functions.  This  set  of 
measurements  is  not  sufficient  for  identification  of  pilot- 
related  model  parameters.  Pilot  remnant  spectra  are  usually 
required  for  proper  identification  of  noise-related  parameters, 
and  having  a more  detailed  set  of  performance  scores  (such  as 
mean-squared  control,  plant,  and  some  rate  variables)  is  helpful. 

Analytic  forcing  function.  Analysis  with  the  optimal- 
control  pilot/vehicle  model  requires  that  the  input  be  represented 
analytically  as  filtered  white  noise.  This  restriction  provides 
no  difficulty  when  the  experimental  input  is  either  filtered 
noise  or  a sum  of  sinusoids  constructed  to  simulate  such  a noise 
process.  Studies  reported  in  the  literature,  however,  have 
tended  to  use  a suni-of-sinusoids  input  constructed  to  simulate 
"rectangular-plus-shelf"  type  of  spectrum  (that  is,  a high- 
amplitude,  low-bandwidth  rectangular  spectrum  to  serve  as  the 
primary  input  signal  plus  a low-amplitude , high-bandwidth 
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rectangular  spectrum  to  allow  measurements  of  pilot  response 
at  higher  frequencies) . Such  an  input  is  difficult  to  represent 
analytically  without  resorting  to  extremely  high-order  represen- 
tations that  substantially  increase  computational  requirements. 

Even  if  the  above  requirement  had  been  met  by  the 
available  data  base,  we  would  still  have  had  to  compare  results 
across  studies  involving  different  subject  populations  and 
different  motion  amplitudes.  Accordingly,  we  decided  to  conduct 
a small  but  carefully-controlled  experiment  to  compare  the  use 
of  motion  cues  in  disturbance  and  command  situations,  as 
described  in  the  remainder  of  this  report. 


17 


3.  DESCRIPTION  OF  EXPERIMENTS 


In  order  to  resolve  apparent  discrepancies  between  the 
results  of  the  preceding  phase  of  this  study  and  those  of  earlier 
studies,  and  to  further  validate  the  pilot  model,  a set  of  experi- 
ments was  conducted  at  AMRL  to  compare  the  utilization  of  motion 
cues  in  disturbance-regulation  and  target- following  tasks.  Pre- 
experimental  model  analysis  was  conducted  to  assure  that  (1) 
roll  rates  and  accelerations  would  be  above  threshold  detection 
levels  but  well  below  the  limits  imposed  by  the  motion  simulator, 
(2)  the  tracking  input  would  provide  a man-machine  response  band- 
width sufficient  for  analysis  of  pilot  response  behavior  while 
providing  a tracking  task  that  was  not  unreasonably  difficult, 
and  (3)  motion  cues  would  have  a statistically  significant  effect 
on  pilot  response  behavior.  This  design  procedure  was  successful, 
and  experimental  results  were  very  close  to  those  predicted 
a priori  by  the  model.  The  design  procedure  has  been  reported 
in  the  literature  [9,  10]. 

3.1  Description  of  the  Tasks 

A Multi-Axis  Tracking  Simulator  (MATS)  was  used  as  the 
controlled  vehicle;  only  the  roll-axis  motion  capability  was 
used  in  this  experiment.  The  simulator  consisted  of  a single- 
seat cockpit  with  a television  monitor  display  and  side  mounted 
force  stick  for  vehicle  control.  The  vehicle  cockpit  was  light- 
tight to  eliminate  external  visual  cues.  The  roll  axis  system 
dynamics  were  identified  and  simulated  on  a hybrid  computer. 

The  system  characteristics  are  presented  in  Table  1. 


18 


Table  1 

Multi-Axis  Tracking  Simulator: 
Roll-Axis  Characteristics 


Plant  Dynamics: 


PLANT 

CONTROL 


K 


20 

s (s  + 20) 


Position  Limit: 
Velocity  Limit: 


90  degrees 
60  degrees/second 

2 

100  degrees/second 


Acceleration  Limit: 


To  test  the  capabilities  of  the  opt imal-control  pilot- 
vehicle  model,  it  was  decided  to  in'^estigate  the  effects  of  two 
types  of  tracking  inputs  in  this  experiment.  One  v;as  defined  as 
the  "target"  condition  because  vehicle  motion  was  commanded  as  a 
result  of  following  a target,  and  the  other  the  "disturbance" 
condition  because  disturbance  inputs  drove  the  vehicle  directly. 

Both  conditions  were  investigated  with  and  without  the  motion  system 
on,  making  a total  of  four  experimental  conditions. 

The  block  diagram  for  the  experiment,  presented  in  Figure  3, 
shows  all  conditions.  The  disturbance  input  was  set  to  zero  for 
the  target  condition,  and  the  target  input  was  set  to  zero  for  the 
disturbance  condition. 

In  the  target  condition  the  task  was  to  follow  a target 
aircraft  in  the  roll  axis.  The  difference  between  the  target  roll 
angle  and  the  controlled  vehicle  position  was  provided  to  the 
human  operator  on  a 9 inch  diagonal  television  monitor.  The 
inside-out  display  consisted  of  a 1.25  inch  long  rotating  line 
whose  center  was  superimposed  upon  a stationary  horizontal  line 
as  indicated  in  Figure  4.  A 0.083  inch  perpendicular  line  at  the 
center  of  the  rotating  line  provided  upright  orientation.  The 
angle  between  the  rotating  and  stationary  line  depicted  the 
difference  between  the  controlled  plant  roll  angle  and  the  target 
roll  angle.  The  display  was  centered  in  azimuth  a distance  of 
about  20  inches  from  the  controller's  eyes.  Subjects'  sitting 
heights  were  such  that  the  display  was  within  10  degrees  of  eye 
level  of  each  subject. 

For  the  disturbance  conditions,  the  displayed  error 
equalled  the  bank  angle  of  the  controlled  vehicle,  and  the  task 
was  to  null  out  the  bank  angle  by  keeping  the  controlled  vehicle 
upright. 
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Figure  3.  Block  Diagram  of  the  Tracking  Task 


Figure  4.  Sketch  of  the  Central  Display 
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A low-pass  filter  with  a break  frequency  of  5 radians/second 
was  added  to  the  simulator  dynamics  to  approximate  roll-axis 
dynamics  of  high-performance  fighter  aircraft;  in  addition, 
recording  and  computational  delays  added  an  effective  overall 
delay  of  about  95  milliseconds  to  the  tracking  dynamics.  With 
the  force  stick  gain  adjusted  to  produce  a steady-state  roll  rate 
of  10  degrees/second  for  one  pound  of  force  at  thumb  height,  the 
controlled  dynamics  were: 

P (s)  ^ 10  _5_  20  -0.095s 

U(s)  s ■ s+5  ■ s+20  ■ 

where  P(s)  is  roll  angle  in  degrees  and  U(s)  is  control  force  in 
pounds . 


To  keep  RMS  response  rate  and  acceleration  well  below  the 
physical  limitations  of  the  rotating  simulator,  as  well  as  to 
encourage  the  test  subjects  (who  were  not  trained  pilots)  to 
respond  in  a smooth  manner,  a performance  criterion  was  defined 
as  the  weighted  sum  of  mean-squared  tracking  error  and  mean- 
squared  vehicle  acceleration: 


C 


0^  + 0.1  a? 

e p 


(4) 


2 

where  C is  the  total  "cost,"  a the  variance  of  the  tracking  error, 

2 ^ 

and  0..  the  variance  of  the  vehicle  acceleration  (or  acceleration  of  the 
P 

simulated  vehicle,  in  the  absence  of  motion  cues) . 


Both  the  target  and  disturbance  inputs  were  constructed 
from  13  sinusoids  whose  amplitudes  were  selected  to  simulate 
random  noise  processes  having  power  spectral  densities  of  the  form 


4) . . 
1 1 


(w) 


( jo)  + ) 


(5) 
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where  was  1.0  rad/sec  for  the  target  input  and  2.0  rad/sec  for 
the  disturbance  input.  Input  amplitude  was  adjusted  to  provide 
an  RMS  target  input  of  10  degrees  or  an  RMS  disturbance  input  of 
14  deg/sec.  In  order  to  prevent  subjects  from  learning  the  input 
waveforms  during  the  experiment,  a random  number  generator  was 
used  to  vary  the  phase  relationships  of  the  input  sinusoids  from 
one  experimental  trial  to  the  next. 

3.2  Experimental  Procedure 

Six  healthy  college  students  between  18  and  25  years  of 

age  were  used  for  the  experiment.  Subjects  tracked  each  condition 

once  each  day.  Tracking  under  each  condition  was  considered  one 

run.  Each  run  lasted  165  seconds  and  the  four  conditions  or  runs 

were  presented  in  a random  order  each  day.  At  the  end  of  each 

run  subjects  were  presented  their  three  performance  scores  for 

2 

that  run:  total  cost  C,  error  variance  a and  weighted 

2 ^ 

acceleration  0.1  o.. . They  were  instructed  to  minimize  the  total 

P 

cost  C.  In  addition,  they  were  told  that  the  error  score  was 
related  to  how  much  error  they  allowed, that  the  acceleration  score 
was  related  to  how  smoothly  they  tracked,  and  that  the  total  score 
was  the  sum  of  the  error  and  acceleration  scores.  They  were  not 
told  predicted  scores,  nor  were  they  told  how  to  divide  their 
total  score  between  error  and  acceleration.  To  maintain  subject 
motivation,  subjects  were  also  made  aware  of  each  other's  per- 
formance scores.  Each  subject  wore  a flight  helmet  with  intercom 
capability  while  performing  the  tracking  task.  The  subject  was 
permitted  to  perform  the  task  briefly  prior  to  each  scored  run  in 
order  to  adjust  mentally  and  physically  to  the  tracking  task. 
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Performance  scores  were  plotted  daily  in  order  to  evaluate 
subject  and  group  performance.  Once  the  error  scores  indicated 
that  the  subjects  had  "learned"  the  tracking  tasks  for  all 
experimental  conditions,  tracking  was  continued  for  another 
eight  days  and  time  history  data  was  collected  for  subsequent 
analysis . 


EXPERIMENTAL  RESULTS 


4 . 

The  major  results  of  the  roll-axis  tracking  experiment 
described  above  are  summarized  in  this  section.  Appendix  B 
contains  additional,  more  detailed  results  in  tabular  form, 
and  some  learning  data  is  analyzed  in  Appendix  C.  Primary 
data  reduction  and  model  analysis  are  described  separately. 

4.1  Primary  Data  Reduction 

4.1.1  Analysis  Procedures 

Total  "cost"  as  defined  in  Equation  (4)  was  computed  for 

each  experimental  trial  used  for  data  analysis.  Also  computed 

for  each  trial  were  variance  scores  for  tracking  error,  error 

rate,  plant  position  (i.e.,  bank  angle),*  plant  rate,  plant 

acceleration,  control  force,  and  control  rate.  To  compute  the 

variance  of  a rate  variable,  we  first  scaled  the  spectrum  of  the 

2 

corresponding  position  variable  by  w and  then  integrated  the 
modified  spectrum;  approximations  were  obtained  for  plant  variance 
as  described  in  Appendix  A. 


Square  roots  were  taken  of  total  cost  and  variance  scores 
to  yield  rms  performance  measures.  These  measures  were  first 
averaged  across  replications  of  a given  test  subject  for  each 
experimental  condition;  the  mean  and  standard  deviation  of  the 
subject  means  pertaining  to  each  experimental  condition  were  then 
computed.  In  order  to  test  for  significant  differences  between 
motion  and  static  conditions,  paired  differences  were  formed 
from  corresponding  subject  means;  these  differences  were  sub- 
jected to  a two-tailed  t-test. 

*For  disturbance-regulation  tasks,  tracking  error  and  error  rate 
were  identical  to  plant  position  and  plant  rate. 
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Frequency-response  analysis  was  similar  to  that  employed 
in  the  preceding  study  [1] . The  pilot  describing  function 
(specified  by  amplitude  ratio  and  phase  shift  as  functions  of 
frequency)  was  computed  by  dividing  the  Fourier  transform  of 
the  pilot's  control  response  by  the  transform  of  the  tracking 
error.  For  situations  in  which  the  rotating  simulator  was 
operative,  this  transfer  function  reflects  the  combined  effects 
of  visual  and  motion  cues  on  pilot  response.  In  all  cases,  the 
measured  phase  shift  was  corrected  to  account  for  phase  lags 
introduced  by  the  simulation  and  data-recording  procedures  as 
described  in  Appendix  A. 

Estimates  of  "pilot  remnant"  were  obtained  by  partitioning 
the  spectrum  of  each  control  response  into  inout-correlated 
and  remnant-related  (i.e.,  stochastic)  components  and,  at  each 
measurement  frequency,  obtaining  the  ratio  of  remnant-related 
to  input-correlated  power.  As  was  done  with  other  performance 
measures,  these  ratios  were  averaged  across  replications  of  a 
given  subject  and  then  across  subjects.  T-tests  were  performed 
on  all  frequency  response  measures  in  the  manner  described  above. 

The  data  base  subjected  to  detailed  analysis  consisted  of 
the  last  eight  trials  per  subject  per  condition,  with  the  exception 
that  trials  yielding  atypical  performance  were  excluded.  "Atypical 
trials  were  identified  as  follows: 

1.  Means  and  variances  for  all  performance  metrics 
were  computed  from  the  last  eight  runs  of  a given 
subject  performing  a given  task. 
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2.  Sets  of  performance  metrics  were  constructed  of 
like  quantities.  That  is,  rms  performance  scores 
consisted  of  one  set,  measures  of  pilot  amplitude 
ratio  another,  etc. 

3.  Tests  for  atypicality  were  performed  individually 
on  each  measurement  set.  Trials  which  yielded  a 
measurement  set  that  was,  on  the  average,  two  or 
more  standard  deviations  away  from  mean  performance 
were  excluded  from  the  data  base. 

This  test  resulted  in  the  exclusion  of  only  three  (out  of 
a total  of  192)  trials.  A similar  test  was  performed  on  the 
subject  means  to  determine  if  the  performance  of  any  subject  was 
atypical  of  the  group.  No  "atypical"  subjects  were  found  by 
this  definition. 

4.1.2  Results 

Variables  for  which  rms  performance  scores  were  computed, 
their  units,  and  their  symbolic  notation  are  shown  in  Table  2. 
Average  rms  performance  scores  are  shown  in  Figure  5.  For  ease 
of  comparison  with  other  performance  metrics,  the  square  root  of 
the  "cost"  defined  in  Equation  (1)  is  shown,  and  various  rms 
scores  have  been  scaled  so  that  all  scores  may  be  shown  on  the 
same  ordinate  scale.  Significant  static-motion  differences  are 
indicated  by  the  arrows,  where  the  coding  of  the  arrow  indicates 
the  significance  level  as  defined  in  Table  3.  Mean  performance 
scores  and  standard  deviations  of  subject  means  are  given  in 
Appendix  B,  Tables  B-1  and  B-2. 
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Table  2 

Tracking  Variables  Analyzed 


Variable 

\ 

Symbol 

Units 

Total  Performance  Cost 
j 

C 

— 

1 

1 Tracking  Error 

e 

degrees 

j Tracking  Error  Rate 

e 

degrees/ second 

j Plant  Position 

P 

degrees 

i Plant  Rate 

J 

P 

degrees/second 

Plant  Acceleration 

P 

degrees/second ^ 

i Control  Force 

u 

pounds 

Control  Rate 

1 

u 

pounds/second 

Table  3 

Coding  for  Significance  Level 


Symbol 

Alpha  Level  of  Significance 

i 

0.05 

t 

0.01 

f 

0.001 

I 


RMS  PERFORMANCE  SCORE  RMS  PERFORMANCE  SCORE 


(a)  TARGET  INPUT 


Figure  5.  Effect  of  Motion  Cues  on  Rms  Performance  Scores 
Average  of  6 subjects. 


Figure  5 shows  that  the  availability  of  motion  cues  had 
little  effect  on  rms  performance  measures  for  the  target- tracking 
task.  Plant  position  showed  the  greatest  effect,  decreasing  by 
about  20%  in  the  motion  case.  Smaller  but  statistically  signi- 
ficant reductions  were  found  for  total  cost  and  for  control-related 
scores.  The  fact  that  statistical  significance  can  be  shown  for 
these  relatively  small  differences  indicates  that  the  influence 
of  motion  cues,  however  slight,  was  consistent  across  subjects. 

Static-motion  differences  were  considerably  greater  for 
the  disturbance-tracking  task.  Although  no  significant  change 
was  observed  in  the  control-related  scores,  total  cost  and 
error-related  scores  were  reduced  substantially;  these  differences 
were  significant  at  the  0.01  level  or  lower. 

The  average  frequency-response  measures  presented  in 
Figure  6 show  that  motion-cue  effects  were  qualitatively  different 
for  the  two  tasks.  The  three  measures  shown  in  the  figure  are, 
from  top  to  bottom,  amplitude  ratio  (i.e.,  pilot  gain), pilot  phase 
shift,  and  the  ratio  of  remnant-related  to  input-correlated  control 
power  (which  we  shall  refer  to  as  the  "remnant  ratio"). 

The  effects  of  motion  cues  on  pilot  response  behavior  for 
the  target-tracking  and  disturbance-regulation  tasks  are  summarized 
in  Table  4.  The  major  influence  of  motion  cues  in  the  target  task 
was  to  induce  a substantial  phase  lead  at  low  frequencies.  There 
was  no  change  in  gain-crossover  frequency  (about  1 rad/sec) , and 
the  remnant  ratio  increased  somewhat.  In  the  disturbance  task, 
however,  motion  cues  allowed  the  subjects  to  convert  a high- 
frequency  phase  lag  into  a substantial  phase  lead,  increase 
amplitude  ratio  at  low  and  mid  frequencies,  and  thereby  increase 
gain-crossover  frequency  from  about  1.5  rad/sec  to  around  3.5  rad/sec. 


REMNANT  AMPLITUDE 

RATIO  (dB)  phase  SHIFT  (deg)  RATIO  (dB! 


Table  4 


Effects  of  Motion  Cues  on  Frequency  Response 


Measurement 

r ' ' ~ , - , ■ ^ - - ■ ■ — ' 

Effects  of  Motion  Cues 

Target  Input 

Disturbance  Input 

Low-frequency  phase 

Substantial  increase 
in  phase  lead 

No  change 

High-frequency  phase 

Small  increase  in 
phase  lag 

Convert  phase  lag 
to  phase  lead,  a 
substantial  change 

Low- frequency 
amplitude- ratio 

No  change 

Substantial  increase 

Gain- crossover 
frequency 

No  change 

Increase  by  over 
factor  of  2 

Remnant  ratio 

Overall  increase 

Overall  decrease 

32 


Although  motion  cues  allowed  the  remnant  ratio  to  decrease  at  all 
frequencies  for  this  task,  static/motion  differences  were  largely 
not  statistically  significant. 

During  the  course  of  this  analysis  we  addressed  the 
question  of  whether  or  not  the  average  pilot  response  characteristics 
shown  in  Figure  6 were  typical  of  the  response  characteristics  of 
individual  subjects.  That  is,  we  wanted  to  ascertain  that  important 
response  characteristics  were  not  obscured  by  the  averaging  process. 
Accordingly,  the  procedure  for  eliminating  atypical  performance 
described  in  Section  4.1.1  was  applied  to  subject  means  to 
successively  eliminate  all  but  one  subject  per  experimental 
condition . 

Figure  7 compares  the  responses  of  typical  subjects  to 
the  average  response  of  all  six  subjects  for  the  static  and  motion 
conditions  in  the  disturbance- regulation  task.  Typical  and 
average  responses  very  nearly  coincided  for  the  static  condition. 

The  correspondence  between  typical  and  average  response  was  also 
high  for  the  motion  condition,  with  only  small  differences  in 
overall  amplitude  of  response.  Thus,  we  are  justified  in 
averaging  these  response  measures  across  subjects. 

4.1.3  Discussion  of  Results 

The  results  obtained  in  this  experiment  agree  qualitatively 
with  results  obtained  previously  in  similar  tracking  situations. 

The  effects  of  motion  cues  in  the  target- tracking  task  are  similar 
to  those  obtained  in  the  preceding  AMRL  experimental  study  for 
"Task  1"  (the  less  severe  of  the  two  tasks  studied  in  that  program). 
In  both  cases,  motion  cues  allowed  an  increase  in  low-frequency 
phase  shift  that  was  unaccompanied  by  any  substantial  improvement 
in  tracking  performance. 


(a)  STATIC 


(b)  MOTION 


Figure  7.  Comparison  of  Typical  and  Mean  Responses 
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Similarly,  the  effects  of  motion  cues  observed  in  the 
disturbance-regulation  task  agree  with  the  effects  reported  by 
other  researchers.  As  noted  in  Chapter  2,  earlier  investigators 
reported  that  moving-base  simulation  allowed  the  pilot  to  reduce 
high-frequency  phase  lag  and  to  increase  gain-crossover  frequency 
and  thereby,  in  many  cases,  lower  his  error  score. 

Motion/static  performance  differences  were  enhanced  some- 
what by  the  time  delays  introduced  by  the  data-recording  and 
computational  algorithms.  These  delays  influenced  only  the 
visual  cues  provided  to  the  pilot;  the  motion  cues  were  provided 
by  the  moving-base  simulator.  Thus,  motion  cues  provided  a double 
benefit  to  the  pilot;  information  was  obtained  via  motion  sensors 
in  advance  of  information  obtained  visually,  and,  as  we  infer 
from  the  model  analysis  described  below,  vehicle  acceleration  and 
possibly  rate-of-change  of  acceleration  were  also  sensed. 

It  is  clear  from  the  results  of  this  experiment  that  the 
effects  of  motion  cues  on  pilot  response  cannot  be  generalized  .in 
terms  of  classical  response  measures.  We  have  shown  that  the 
effects  of  motion  cues  on  rms  performance  scores,  pilot  describing 
function,  and  pilot  remnant  can  all  differ  qualitatively  from  one 
control  situation  to  the  next.*  Some  form  of  generalization  is 
needed,  nevertheless,  if  we  are  to  extrapolate  the  results  of 
these  and  earlier  experiments  to  other  control  tasks  of  interest. 
That  is,  we  need  a model  which  accounts  for  the  interaction 
between  available  motion  cues  and  pilot  response  in  terms  that 
are  essentiall  independent  of  the  details  of  the  control  task. 
Such  a model  is  discussed  below. 

*Relative  effects  of  motion  cues  are  affected  not  only  by  the  type 
of  external  input,  as  demonstrated  here;  pre-experimental  model 
analysis  indicated  that  input  bandwidth  and  performance  criterion 
would  also  influence  motion/static  differences  in  response 
behavior . 
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4.2 


Model  Analysis 


4.2.1  Analysis  Procedure 

The  revised  optimal-control  pilot/vehicle  model  developed 
in  the  preceding  phase  of  this  study  was  applied  to  the  results 
of  the  experiment  described  above.  This  model  is  described  by 
Levison,  Baron,  and  Junker  [1]. 

The  treatment  of  motion  cues  was  similar  to  that  of  the 
preceding  study  in  that  the  presence  or  absence  of  motion  cues 
was  represented  by  an  appropriate  definition  of  the  sensory 
variables  assumed  to  be  available  to  the  pilot.  A three-element 
"display  vector"  consisting  of  tracking  error,  error  rate,  and 
(in  one  instance)  error  acceleration  was  used  to  model  static-mode 
tracking.  To  model  pilot  response  in  moving-base  tasks,  we  simply 
expanded  this  display  vector  to  include  position,  rate,  accelera- 
tion, and  acceleration-rate  of  the  vehicle;  no  other  model  para- 
meters were  changed  to  account  for  motion/static  differences. 

Model  runs  were  also  obtained  which  included  the  effects  of 
dynamic  response  properties  of  vestibular  motion  sensors.  System 
equations  of  motion  used  in  the  model  analysis  are  given  in 
Appendix  C. 

The  scheme  for  identifying  model  parameters  was  similar 
to  that  employed  in  the  preceding  study  program.  Parameter  values 
were  sought  that  would  simultaneously  provide  a good  match  to  per- 
lormance  scores,  describing  function,  and  remnant  ratio.  A multi- 
dimensional "matching  error"  was  defined,  with  the  dimensions 
being  (1)  rms  performance,  (2)  amplitude  ratio,  (3)  phase  shift, 

(4)  and  remnant  ratio.  Matching  error  was  defined  in  such  a way 
that  a score  of  unity  was  obtained  whenever  model  predictions 
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differed  on  the  average  from  experimental  measurements  by  one 
standard  deviation.  Additional  details  concerning  the  compu- 
tation of  matching  error  are  found  in  [1] . 

As  in  the  preceding  study,  the  primary  goal  of  model 
analysis  was  to  determine  a straightforward  and  reliable  pro- 
cedure for  predicting  the  effects  of  motion  cues  in  a variety 
of  control  tasks.  Therefore,  we  attempted  to  account  for  per- 
formance on  all  four  tasks  with  the  fewest  variations  in  para- 
meter values.  We  did  not  allow  all  parameters  to  vary  in  order 
to  obtain  the  best  match  in  each  condition;  rather,  variations 
were  made  in  only  those  parameters  that  could  reasonably  be 
expected  to  relate  to  the  kind  and  quality  of  information 
provided  to  the  pilot. 

4.2.2  Primary  Results  of  Model  Analysis 

Attentional  parameters  were  the  only  model  parameters  that 
were  varied  across  experimental  conditions;  all  other  parameter 
values  were  held  fixed.  Numerical  values  for  these  parameters, 
shown  in  Table  5,  were  obtained  as  follows: 

Control-Hate  Coat  Coe  j' f iaient . Based  on  previous  studies 
of  single-var iable  laboratory  tracking  tasks,  the  control-rate 
cost  coefficient  was  adjusted  to  provide  a "motor  time  constant" 
of  0.1  second . 

Acceleration  Coat  Coefficient . In  accordance  with 
instructions  given  to  the  subjects,  we  initially  attempted  to 
match  experimental  results  with  an  acceleration  cost  coefficient 
of  0.1  seconds.  A somewhat  better  match  was  obtained  with  a 
coefficient  of  0.05,  however,  and  this  latter  value  was  adopted 
for  the  remainder  of  the  analysis. 
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Table  5 

Values  for  Pilot-Related  Model  Parameters 


a.  Invariant  Parameters 

{ Control-rate  cost  coefficient 
j Motor  time  constant 
I Acceleration  cost  coefficient 
I Time  delay 

I 

I Driving  motor  noise/signal  ratio 
Pseudo  motor  noise/signal  ratio 
Observation  noise  ratio  for  "Full  Attention 
Perceptual  thresholds,  error  rate,  visual 
Perceptual  Thresholds,  all  other  variables 


1.0 

0 . 1 seconds 
0.05 

0.22  seconds 
(negligible) 
-30  dB 
-20  dB 
3 . 2 deg/sec 
(negligible) 


b.  Attentional  Allocation 


Tracking  Task 

Perceptual 

Perceptual 

Target 

Input 

Disturbance 

Input. 

Mode 

Variable 

Static 

Motion 

Static 

Motion 

Visual 

error 

1 

0.95 

1 

0.1  1 

1 

error  rate 

1 

0.95 

1 

0.1  I 

1 

error  acceleration 

— 

— 

0.05 

0 i 

Motion 

plant 

0 

0.05 

0 

0.9  1 

plant  rate 

0 

0.05 

0 

0.9 

! 

plant  acceleration 
plant  acceleration 

0 

0.05 

0 

1 

1 

0.9 

! 

rate 

0 

0.05 

0 

0.9 
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Time  Delay.  A time  delay  of  0.22  seconds  provided  the 
best  match  across  conditions. 

Motor  Noise/Signal  Ratios.  On  the  basis  of  previous 
analysis,  the  "driving"  motor  noise/signal  ratio  was  made 
negligibly  small;  a "pseudo"  noise/signal  ratio  of  -30  dB  gave 
a reasonably  good  match  to  low-frequency  phase  shift  (See  Levison, 
Baron,  and  Junker  for  a discussion  of  the  motor  noise  aspect  of 
the  pilot  model.) 

Observation  Noise/Signal  Ratio.  On  the  basis  of  previous 
studies,  an  observation  noise/signal  ratio  of  -20  dB  was  adopted. 

: ■-r  -eptual  Thresholds.  Because  vehicle  roll  rates  and 
accelerations  were  large  compared  to  published  detection  thresholds 
for  these  variables,  thresholds  for  motion-related  variables  were 
set  to  zero.  A good  match  to  the  data  was  obtained  with  thresholds 
of  0 degrees  and  3.2  deg/sec  associated  with  visually-obtained 
error  and  error  rate.  As  discussed  in  Appendix  C,  these  values 
were  smaller  than  those  obtained  from  preliminary  display  analysis. 

Attentional  Variables.  With  the  exception  of  visually- 
obtained  error  acceleration,  attention  was  assumed  to  be  shared 
between  visual  display  variables  as  a group  and  motion  variables 
as  a group,  and  there  was  assumed  to  be  no  interference  among 
perceptual  quantities  within  a sensory  mode.  The  absence  of 
motion-related  information  in  a tracking  task  was  modeled  as  zero 
attention  (i.e.,  extremely  large  observation  noise)  on  motion 
variables  and  unity  attention  on  visual  variables.  The  atten- 
tional allocations  between  visual  and  motion  cues  shown  in 
Table  5 provided  the  best  match  to  the  data. 
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Figure  8 shows  that  the  model  accurately  reflected  the 
influence  of  both  the  nature  of  the  external  input  and  the 
presence  or  absence  of  motion  cues.  Of  the  28  performance 
scores  predicted  by  the  model,  all  but  three  were  within  10 
percent  of  corresponding  experimental  measures;  and  in  only  one 
of  these  cases  did  the  model  score  fail  to  be  within  one  stanaard 
deviation  of  the  experimental  mean. 

As  shown  in  Figure  9,  model  outputs  agreed  quite  well 
with  experimental  frequency-response  measures,  and  major  trends 
in  the  data  were  predicted.  Specifically,  inclusion  of  motion- 
related  sensory  information  caused  the  model  to  predict  an 
increase  in  low-frequency  phase  shift  for  the  target  task.  For 
the  disturbance  task,  the  model  correctly  predicted  large  increases 
in  low-frequency  gain  and  high-frequency  phase  lead.  The  model 
also  predicted  an  overall  decrease  in  remnant  ratio  for  this 
task . 


It  is  worthwhile  to  re-emphasize  that  the  effects  of 
motion  cues  have  been  accounted  for  solely  by  changes  in  model 
parameters  related  to  the  information  availability  and  quality; 
other  parameters  have  been  kept  fixed  for  the  four  experimental 
conditions . 

Values  for  two  of  the  parameters  — cost-of-acceleration 
and  time  delay  — were  somewhat  different  from  those  initially 
expected.  The  acceleration  cost  coefficient  that  provided  the 
best  fit  to  the  data  was  half  that  used  in  computing  the  total 
performance  cost  during  the  experiments.  In  order  to  estimate 
the  subject's  ability  to  detect  differences  between  subjective 
and  objective  cost  criteria,  model  results  were  obtained  for 
acceleration  cost  coefficients  of  0.05,  0.1,  and  0.2.  The 
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weighting  on  control  rate  was  varied  to  maintain  a motor  time 
constant  of  0.1  seconds,  and  other  model  parameters  were  kept 
fixed  at  values  shown  in  Table  5.  This  sensitivity  study  was 
performed  for  the  target- tracking  task,  visual  inputs  only. 

Total  cost,  computed  as  defined  in  Equation  (4) , varied 
by  less  than  5%  for  the  range  of  cost  coefficients  explored 
(a  factor  of  4).  Therefore,  the  subjects  had  no  clear  indica- 
tion that  their  performance  was  not  optimal  (as  defined  by  the 
objective  cost  criterion).  In  effect,  they  achieved  a slight 
reduction  in  error  score  by  allowing  a slight  increase  in 
acceleration  score  with  no  perceptible  effect  on  overall  per- 
formance cost. 

The  best-fitting  time  delay  of  0.22  seconds  was  outside 
the  range  (0.15  to  0.20  seconds)  usually  found  in  laboratory 
trackina  tasks  employing  plant  dynamics  of  reasonable  bandwidth. 
Again,  the  pilot  may  have  operated  with  this  time  delay  because 
of  the  relative  insensitivity  of  performance  to  this  parameter. 
.Model  analysis  of  the  target/visual  task  showed  that  the  total 
cost  associated  with  a time  delay  of  0.22  seconds  would  be  only 
about  6%  greater  than  the  cost  achieved  with  a time  delay  of 
0.15  seconds.  The  lack  of  sensitivity  of  performance  to  time 
delay  reflects,  at  least  in  part,  the  restraining  influence  of 
the  acceleration  cost  on  response  bandwidth.  That  is,  the  imposi- 
tion of  a cost  on  acceleration  imposes  a reduction  in  pilot  gain, 
which  in  turn  reduces  man-machine  system  bandwidth.  This 
factor  would  tend  to  mask  the  effects  of  moderate  increases  in 
pilot  time  delay. 
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The  principal  effect  of  including  a low  level  of  atten- 
tion to  visually-obtained  error  acceleration  in  the  disturbance/ 
static  condition  is  to  improve  the  match  to  high-frequency 
remnant.  This  result  is  consistent  with  an  earlier  study  by 
Levison  of  the  effects  of  display  bandwidth  on  visual-only 
tracking  [11).  Overall  tracking  performance,  however,  is  little 
influenced  by  the  availability  of  error  acceleration  information 
at  the  level  indicated  in  Table  5.  Removal  of  this  quantity  from 
the  display  vector  causes  an  increase  in  rms  tracking  error  of 
less  than  3 percent,  and  other  scores  change  by  even  smaller 
amounts . 

4.2.3  Alternate  Hypotheses 

As  in  the  preceding  study,  we  have  assumed  that  there  is 
interference  (i.e.,  attention-sharing  requirements)  between 
visual  inputs  as  a group  and  motion  variables  as  a group.  We 
have  also  introduced  a new  hypothesis:  that  acceleration  rate 

("jerk")  is  one  of  the  cues  provided  to  the  subject  in  the 
moving-base  simulation. 


Average  matching  errors  are  shown  in  Figure  10  for  the 
various  hypotheses.  Also  shown  are  the  matching  errors  for  the 
individual  measurement  dimensions  (rms  performance  scores,  pilot 
gain,  pilot  phase  shift,  and  remnant  ratio).  The  assumption  of 
interference  provided  somewhat  lower  matching  errors  for  the  target- 
following results  — essentially  no  difference  for  the  disturbance- 
regulation  results.  Thus,  we  cannot  claim  to  have  proven  the 
existence  of  interference,  only  that  such  a hypothesis  is  consistent 
with  the  data. 


Inclusion 
model  predictions 
hypothesis  is  not 


of  jerk  in  the  display  vector  has  no  effect  on 
for  the  target-following  task;  thus,  this 
shown  in  Figure  10a.  Figure  10b  shows,  however. 
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that  inclusion  of  jerk  reduced  the  matching  error  on  phase  shift 
by  over  a factor  of  4 and  substantially  reduced  other  component 
errors  as  well.  The  improvement  occurred  largely  at  high- 
frequencies,  where  the  absence  of  jerk  caused  the  model  to 
predict  that  phase  shift  would  begin  to  fall  off  rapidly  above 
8 rad/sec . 

Although  the  matching  error  is  considerably  reduced  by 
including  jerk  in  the  "display  vector,"  predicted  system  per- 
formance is  influenced  relatively  little  by  this  consideration. 
As  shown  in  Figure  11,  both  predicted  rms  error  and  predicted 
rms  roll  acceleration  are  reduced  by  about  10%  for  "full 
attention"*  to  the  task;  these  differences  are  predicted  to 
disappear  as  less  attention  is  paid  to  the  tracking  task. 

4.2.4  Analysis  Including  Motion  Sensor  Dynamics 

The  disturbance-regulation  task  was  re-analyzed  with 
the  vestibular  sensor  dynamics  of  equations  (1)  and  (2)  added 
to  the  system  equations  of  motion.  The  vector  of  displayed 
quantities  available  to  the  pilot  now  consisted  of  tracking 
error  and  error-rate  (associated  with  visual  sensors) , and  the 
outputs  and  rate-of-change  of  outputs  of  the  semicircular  canal 
and  otolith  sensors,  making  a total  of  six  possible  sensory 
variables . 

The  specific  force,  in  units  of  g,  was  defined  as 

SF  = sin  - I (6) 

where  (})  is  the  bank  angle  of  the  motion  simulator,  R is  the 

*"Fu11  attention"  corresponds  to  a base  observation  noise/signal 
ratio  of  20  dB  - a level  that  pilots  have  been  found  to  adopt 
for  most  laboratory  tracking  tasks  in  which  they  are  motivated 
to  perform  well. 
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distance  from  the  point  of  rotation  to  the  estimated  location  of 

the  vestibular  sensors,  and  g the  acceleration  of  gravity.  With 

2 

the  average  R estimated  as  3.0  ft,  g=32.2  ft/sec  , and  sin  0 
assumed  approximately  equal  to  0,  specific  force  was  computed  as 

SF  = C-  - 0.09  3 '({i  (7) 

Model  predictions  were  obtained  under  the  assumptions  that 
(1)  only  the  primary  output  of  the  motion  sensors  were  available 
to  the  pilot,  along  with  visual  cues,  and  (2)  rate-of-change  of 
sensors  outputs  were  directly  perceived,  along  with  the  other 
motion  and  visual  cues.  In  addition,  alternative  hypotheses  of 
interference  and  non-interference  between  visual  and  motion  cues 
were  explored.  Interference  was  modeled  by  allocating  atten- 
tions of  0.1  to  visual  cues  and  0.9  to  motion  variables.  Except 
for  manipulations  of  attentional  and  display  variables,  values 
for  pi lot- related  model  parameters  were  as  shown  in  Table  5. 

The  best  overall  match  to  the  experimental  data  was 
obtained  under  the  assumptions  of  availability  of  motion-sensor- 
rate  information  and  non-interference  between  sensory  modes. 
However,  the  best  fit  was  substantially  less  good  than  that 
obtained  with  the  simple  information  discussed  above.  Overall 
normalized  matching  error  was  3.1,  with  the  least  good  match 
being  obtained  to  phase  shift  (a  matching  error  of  7.6) . 

The  failure  of  this  particular  set  of  vestibular-sensor 
models  to  account  for  the  data  obtained  in  the  disturbance- 
regulation  tas)c  apparently  stems  from  the  inability  of  these 
models  to  provide  adequate  high-frequency  derivative  information. 
(Note  that  in  the  target- tracking  tasks  explored  in  the  previous 
study  phase,  lou- f requeriry  lead  information  was  needed.)  Even  if 


4B 


sensor-rate  information  is  assumed  to  bo  directly  perceived  by 
the  pilot,  the  following  shortcomings  are  encountered:  (1) 

acceleration  information  available  from  the  semicircular  canals 
IS  filtered  at  high  frequencies;  (2)  acceleration  information 
from  the  otoliths  is  confounded  with  position  information:  and 
(3)  jerk  information  is  not  directly  available  to  the  pilot. 

The  vestibular  models  recently  used  by  Curry,  Hoffman,  and 
Young  [12]  appeared  to  provide  the  desired  high-frequency  in- 
formation and  model  results  were  obtained  with  this  model  set. 

As  described  in  Appendix  C,  system  equations  were  augmented  by 
the  following  model  elements: 

188  (.02s  +1)  .. 

Y = (})  (o) 

^ (18s  +1)  (30s  +1) 


Y 

o 


91 . 1 (s  + . 0988) 
(s  + 0.2) 


SF 


(9) 


where  Y^  and  Y^are  outputs  proportional  to  the  sensations  yielded 

by  the  semicircular  canals  and  otoliths,  respectively.*  Tn 

addition,  the  rate  quantities  Y and  Y were  included  as  cutouts 

s o 

available  to  the  pilot  in  some  of  the  model  runs. 

Model  analysis  was  conducted  as  described  above.  Again, 
the  best  match  to  experimental  data  was  obtained  with  the  assump- 
tion that  motion-sensor-rate  information  was  used  and  that  there 
was  no  interference  between  visual  and  motion  cues.  The  match 


*The  models  used  by  Hoffman  et  al . also  included  residual  noise 
terms  to  reflect  sensory  resolution  limitations.  Because  vehicle 
accelerations  encountered  in  AMRL  experiments  were  large  compared 
to  published  sensory  thresholds,  these  noise  terms  were  neglected 
in  the  analysis. 
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to  the  data,  however,  was  much  closer  than  with  the  previously 
explored  vestibular  models.  Average  normalized  matching  error 
was  about  0.77  with  a maximum  component  error  (on  phase)  of 
about  1.3.  Performance  scores  were  closely  matched  as  well: 
predicted  rms  scores  differed  from  experimental  scores  by  less 
than  3%  average  absolute  error  in  amplitude  ratio  was  about  0.3 
dB , average  error  in  phase  less  than  4 degrees,  and  average  error 
in  remnant  ratio  was  about  0.4  dB . 

As  was  the  case  with  the  results  of  the  previous  study,  we 
again  find  that  models  of  vestibular  dynamics  are  consistent  with 
results  obtained  experimentally  (provided  we  select  the  right 
models) , but  overall  modeling  accuracy  is  not  enhanced  by  the 
consideration  of  such  motion-sensor  models.  Thus,  a straightforward 
informational  analysis  would  appear  to  be  adequate  for  predicting 
the  effects  of  motion  cues  on  tracking  performance  and  pilot 
response  for  the  types  of  control  tasks  considered  in  this  study. 

On  the  basis  of  results  explored  so  far  under  this  contract 

t 

the  inclusion  of  vestibular  system  dynamics  in  the  pilot/vehicle 
model  appears  to  impose  an  unnecessary  computational  burden. 

This  may  be  partly  because  of  the  existence  of  potential  sources 
of  motion  information  (e.g.,  tactile  and  kinesthetic  cues)  not 
accounted  for  by  models  of  vestibular  sensory  apparatus.  Also, 
as  noted  earlier,  this  analysis  has  been  devoted  to  steady-state 
tracking  tasks  in  which  response  power  has  largely  been  within 
the  passband  of  the  vestibular  sensors;  thus,  dynamic  response 
characteristics  of  the  latter  would  not  play  an  important  role 
in  determining  pilot  response.  For  transient  maneuvers,  on  the 
other  hand,  such  dynamics  could  well  be  important. 
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4 . 2 . b Roanalysis  with  Typical  Pilot  Parameters 

By  allowing  nearly  all  oilot-related  model  parameters  to 
vary  from  one  study  to  the  next,  we  have  been  able  to  obtain 
close  agreement  between  model  and  experimental  results  for 
all  tasks  explored  in  the  two  studies  completed  under  this  con- 
tract. Many  of  these  parameter  differences  have  been  attributed 
to  the  relative  insensitivity  of  overall  system  performance  to 
such  parameter  values. 

If  the  model  is  to  bo  used  as  a V7‘ediative  rather  than  as 
a ■iiagnostia  tool,  it  is  important  that  one  be  able  to  predict 
the  effects  of  task  variables  on  system  performance  using  a single 
set  of  typical  pilot  parameter  values.  Because  there  generally 
exists  a range  of  pilot  response  behavior  that  gives  near-optimal 
system  performance  in  a typical  control  situation,  one  wold  not 
expect  suc.h  a procedure  to  yield  accurate  predictions  of  all 
response  metrics.  Nevertheless,  one  would  exoect  that  important 
trends  in  system  behavior  would  be  revealed. 

To  test  the  predictive  capability  of  the  model,  a comparison 
was  obtained  between  measured  and  predicted  rms  tracking  error  for 
all  eight  tasks  explored  under  this  contract,  using  a set  of 
"typical"  pilot  parameter  values.  These  values  were  chosen  largely 
on  the  basis  of  previous  laboratory  studies  and  are  not  necessarily 
those  that  would  provide  the  best  overall  fit  to  the  data  base. 

The  following  parameter  values  were  used: 

2 2 

Coct  Functional.  Cost  functionals  were  J = o_  + o . 

^ u 

for  the  tasks  explored  in  the  previous  study  phase  [1]  and  J = 

2 „ , 2 ? 

a + 0.1  o..  + n 0 for  the  tasks  described  in  this  report.  The 

^ p 0 

coefficient  G was  chosen  to  provide  a motor  time  constant  of  0.1 
seconds  in  all  cases. 
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Delay.  A pilot  time  delay  of  0.2  seconds  was  assumed. 

Perceptual  Thresholda . Thresholds  of  1.6  degrees  for  visual 
perception  of  tracking  error  and  6.4  degrees/second  for  visual 
perception  of  error  rate  were  calculated  as  described  in  Appendi.x 
C.  Because  of  the  large  vehicle  motions,  thresholds  for  motion- 
derived  perceptions  were  assumed  negligible. 

Motor  Noise /Jignal  Ratios.  Driving  motor/noise  signal 
ratio  was  negligibly  small;  pseudo  noise/signal  ratio  was  set 
at  -35  dB. 

Observation  Noise /Signal  Ratio.  A value  of  -20  dB  was  used. 

As  shown  in  Figure  12,  model  predictions  correlated  well 
with  experimental  measures.  ("Year  1"  and  "Year  2"  refer  to  the 
studies  described  in  [1]  and  in  this  report,  respectively.)  All 
significant  trends  related  to  task  configuration  and  availability 
of  motion  cues  were  predicted.  Furthermore,  individual  scores 
were  predicted,  on  the  average,  to  within  15%. 
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5.  CONCLUSIONS 

The  principal  results  of  this  study  may  be  summarized  as 
follows : 

1.  The  effects  of  motion  cues  on  task  performance  and 
pilot  response  behavior  are  strongly  dependent  on  the 
structure  of  the  tracking  task.  The  major  effect  of 
motion  cues  in  a target- following  task  is  ‘to  allow  the 
pilot  to  generate  low-frequency  phase  lead;  in  a 
disturbance-regulation  task,  the  main  effects  are  more 
phase  lead  (alternatively,  less  phase  lag)  at  high 
frequencies  accompanied  Py  an  increase  in  gain-crossover 
f requency . 

2.  Because  of  the  strong  interaction  between  motion-cue 
effects  and  task  structure,  a pilot/vehicle  model  is 
required  to  generalize  the  results  from  one  task  to 
the  next. 

3.  The  "optimal-control"  model  for  pilot/vehicle  systems 
provides  a task- independent  framework  for  accounting 
for  the  pilot's  use  of  motion  cues.  Specifically, 

the  availability  of  motion  cues  is  modeled  by  augmenting 
the  set  of  assumed  perceptual  variables  to  include  position, 
rate,  acceleration,  and  acceleration  rate  of  the  moving 
vehicle . 

4.  Results  are  consistent  with  the  hypothesis  that  the 
subject  shares  attention  between  visual  variables  as  a 
group  and  motion  variables  as  a group.  This  hypothesis 
has  not  been  conclusively  proven,  however. 

5.  Variations  in  model  parameters  relating  to  motion-cue 
availability  and  attention-sharing  as  described  above 
are  sufficient  to  enable  the  model  to  replicate  the 
effects  of  motion  on  all  performance  metrics  for  the 
tasks  explored  in  this  study. 
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6.  Using  the  model  for  motion-cue  utilization  defined 
above,  plus  a single  "typical"  set  of  pilot-related 
model  parameters,  one  can  obtain  accurate  model  pre- 
dictions of  rms  tracking  error  scores  for  all  task 
configurations  explored  in  this  study  and  in  the 
preceding  study. 

7.  There  is  some  evidence  that  low-quality  acceleration 
information  can  be  obtained  directly  from  the  visual 
display  in  some  tasks.  The  influence  of  such  information 
processing  on  tracking  performance  appears  to  be 
minimal,  however. 

8.  Use  of  acceleration-rate  information  appears  to  allow 

a modest  reduction  in  rms  tracking  error  in  some  tasks. 

9.  Results  are  consistent  with  existing  models  for  motion 
perception  by  vestibular  sensors.  Such  models  are  not 
needed  to  explain  the  data  obtained  in  this  study, 
however . 
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APPENDIX  A 
ANALYSIS  PROCEDURES 

This  Appendix  describes  certain  details  of  the  data  analysis 
procedures:  specifically  (1)  treatment  of  delays  introduced  in 

data  recording  and  simulation  algorithms,  and  (2)  comnutation  of 
vehicle  acceleration. 

A.l  Treatment  of  Simulation  and  Computational  Delays 

Because  the  simulation  involved  both  analog  and  digital 
computation,  delays  were  unavoidably  introduced  into  the  tracking 
loop  as  well  as  into  the  measurement  of  pilot  describing  function. 
Figure  A-1  shows  the  principal  sources  and  locations  of  delays 
that  were  important  in  the  target- following  tracking  task.  (Analysis 
of  the  disturbance-regulation  task  is  similar  and  is  not  discussed 
separately . ) 

The  pilot  manipulated  a control  stick,  which  generated  an 
analog  output  that  was  fed  directly  to  the  (analog)  simulated 
vehicle.  Both  the  stick  and  plant  outputs  were  filtered  through 
identical  second-order  Butterworth  filters  and  digitized.  The 
filter  frequency  was  40  rad/sec;  for  purposes  of  analysis,  filter 
response  has  been  approximated  by  a pure  delay  (T^)  of  0.040 
seconds . 

The  digitized  plant  response  was  differenced  with  the 
digitally-generated  tracking  input  to  form  the  tracking  error, 
which  was  then  displayed  to  the  pilot.  Simulation  delays  (T2) 
on  the  order  of  0.055  seconds  were  associated  with  computation 
and  display  generation  and  are  shown  as  such  in  Figure  A-1. 
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E = TRACKING  ERROR 
H = EQUIVALENT  HUMAN  OPERATOR 
RESPONSE  TO  VISUAL  INPUTS 
I = TRACKING  INPUT 
P = PLANT  POSITION 
s = LAPLACE  FREQUENCY  VARIABLE 
Tz  = EFFECTIVE  DISPLAY  AND 
COMPUTATIONAL  DELAY 
T,  = EFFECTIVE  RECORDING  DELAY 
U = PILOT'S  CONTROL  INPUT 
V = VEHICLE  DYNAMIC 

RESPONSE  CHARACTERISTICS 
"a"=  SIGNIFIES  ANALOG  DOMAIN 
"d"=  SIGNIFIES  DIGITAL  DOMAIN 


Figure  A-1.  Flow  Diagram  of  the  Tracking  Task 
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It  is  clear  from  Fiqure  A-1  that  both  recording  and  simula- 
tion delays  appear  in  the  tracking  loop  insofar  as  the  visual 
display  is  concerned.  (Note  that  motion  cues  are  obtained 
directly  from  plant  motion  and  are  not  affected  by  either  source 
of  delay.)  Thus,  model  analysis  of  the  pilot's  response  to  visual 
information  must  include  the  total  delay  of  0.095  seconds  as  part 
of  the  effective  vehicle  response  characteristics. 


Measurements  of  the  human  operator  describing  function  must 
be  corrected  as  well  to  remove  the  bias  introduced  by  these  delays. 
Although  the  human  operator  had  the  opportunity  to  respond  to  both 
motion  as  well  as  visual  cues  in  the  moving-base  simulations,  an 
"equivalent  visual  describing  function"  was  defined  simply  as  the 
Fourier  transform  of  the  control  signal  divided  by  the  transform 
of  the  error  signal.  The  uncorrected  describing  function  (H') 
was  computed  as  follows: 


-r  -sTt  „ -sT, 

I,  • e 2 H e 1 
d 

1 + HV  e“^ (T^+T2) 


- I 


1 + HV  e ^ (T^+T^, 


(A-1) 


(A-2) 


= H 


e-s(Ti+T2) 


(A-3) 


Thus,  the  computed  human  operator  describing  function  is  biased  by 
the  same  delay  that  is  added  to  the  effective  vehicle  dynamics. 
Therefore,  all  experimental  phase-shift  data  presented  in  this 
report  have  been  corrected  by  a phase  lead  corresponding  to  a time 
advance  of  0.095  seconds. 


Estimation  of  Plant  Acceleration 


A.  2 


As  direct  measurement  of  vehicle  acceleration  was  not 
available,  estimates  of  acceleration  had  to  be  computed  from 
other  measurements . Two  procedures  wore  adopted  for  estimatin 
acceleration:  one  for  obtaininq  an  instantaneous  estimate  of 

the  total  "cost,"  the  other  for  obtaining  a post-experiment 
estimate . 


A.  2.1  Instantaneous  Estimate  of  Acceleration 


The  plant  output  was  related  to  control  input  as 


$ = U • 10  • 

5 

20 

s + 5 

s + 20 

where 

the  terms  are 

written  to 

f low . 

That  is,  the 

pilot ' 

' s con 

by  a factor  of  10,  filtered  by  the  dynamics  of  5/(s+5)  to 
represent  high-performance  aircraft  roll  characteristics, 
filtered  again  by  20/(s+20)  (the  approximate  dynamics  of  the 
moving-base  simulator) , and  finally  integrated  to  convert  roll 
rate  to  roll  angle.  In  the  static  tasks,  the  final  filtering 
and  integration  were  performed  by  the  analog  simulator;  in  the 
motion  case,  these  operations  were  performed  directly  by  the 
moving-base  simulator. 

An  estimate  of  plant  acceleration  was  obtained  from  the 
portion  of  the  simulation  representing  aircraft  dynamics.  The 
output  of  this  simulation  element  was  computed  as 


X = 


50  U - 5 X 
s 
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(A-4) 


(A-5) 


J 


Since  this  operation  was  performed  on  the  analog  computer,  and  not 
by  a moving  physi  al  device,  the  input  to  the  integrator  generating 
the  signal  "x"  was  available.  This  signal,  x,  was  related  to  the 
control  input  as  follows: 


50  s 
s+5 


U 


(A-6) 


and  was  therefore  related  to  the  plant  position  as 


+ 20  2 


(A-7) 


Since  most  of  the  pilot's  response  power  was  concentrated  at 
frequencies  below  20  rad/sec,  the  measurement  of  x was  considered 
to  provide  a reliable  estimate  of  vehicle  acceleration. 


A. 2. 2 Post-Exoer iment  Estimate  of  Acceleration 


For  purposes  of  post-experiment  analysis  of  performance, 
an  estimate  of  acceleration  was  obtained  by  scaling  the  power 

4 

spectrum  of  the  plant  by  oj  , scaling  again  by  the  magnitude  of 
the  transfer  function  of  a second-order  Butterworth  filter  having 
a break  frequency  at  10  rad/sec,  and  integrating  the  resulting 
spectrum.  (The  filtering  was  imposed  to  reduce  contributions  of 
high-frequency  noise  inherent  in  the  differentiation  process.) 

On  the  average,  the  two  methods  of  estimating  plant  acceleration 
differed  by  less  than  7%. 
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APPENDIX  B 

ADDITIONAL  EXPERIMENTAL  RESULTS 


This  Appendix  contains  additional  data  to  supplement  the 
discussion  in  Section  4 of  the  recent  roll-axis  tracking  study. 
Tables  B-1  and  B-2  give  across-sub ject  means  and  standard 
deviations  of  performance  costs  and  rms  performance  scores, 
respectively.  Statistics  of  frequency-response  measures  are 
given  in  Tables  B-3  through  B-5.  "Significance  levels"  indicate 
alpha  levels  of  significance  for  motion-static  differences; 
differences  significant  at  levels  greater  than  0.05  are  considered 
not  significant  (NS) . 
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Table  B-1 

Effect  of  Motion  Cues  on  Performance  Costs 


Variable 

Static 

I Motion 

Significance 

Mean  j Std  Dev 

j Mean 

std  Dev 

L'--  - .. 

Level 

a.  Target  Input 


Total  Cost 

73.3 

8.  30 

65.4 

4 .75 

.05 

Error  Cost 

51.0 

11 . 8 

47.1 

9 . 38 

NS 

Acceleration  Cost 

22.2 

8.27 

18 . 3 

7.50 

NS 

b.  Disturbance 

Input 

Total  Cost 

196 

26  . 3 

78.6 

14 . 3 

.001 

Error  Cost 

81 . 3 

31 . 3 

20.5 

14.2 

.01 

Acceleration  Cost 

115 

34.1 

58.1 

6.24 

< 

.01 
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Table  B-2 

Effect  of  Motion  Cues  on  Rms  Performance  Scores 


Variable 


Static 

Mean  I Std  Dev 


Significance 

Level 


arciet  Input 


Error  7.08 
Error  Rate  11.9 
Control  .753 
Control  Rate  ! 2.22 
Plant  j|  9.25 
Plant  Rate  j 7.12 
Plant  Acceleration  l|  14.1 


6.84 
11.8 
.669 
1 .99 
7 . 50 
6. 74 
15.3 


.674 
. 792 
.152 
.482 
1.20 
1 . 71 
3.37 


b.  Disturbance  Input 


Error 

8.82 

1.68  j 

4 . 24 

1.44! 

Error  Rate 

11 . 9 

1.31  , 

6.81 

1.44 

Control 

1 . 55 

. 119  1 

1 . 49 

.067  ! 

Control  Rate 

3.79 

1.27 

3.82 

. 689  1 

Plant  Acceleration 

31 . 9 

3.41  ! 

23.5 

Table  B-3 

Effect  of  Motion  Cues  on  Pilot  Describing  Function, 

Target  Input 


Frequency 

t 

1 

Motion 

1 Significance 

( rad/sec) 

1 

Mean  ' Std  Dev 

, Level 

j 

a.  Amplitude  Ratio  (dB) 


0.19 

1 

-21.3 

2.4  1 

-26.7 

17^ 

0.5  i 

-21.2 

2.0  1 

-21.6 

3.2 

NS 

1.0  i 

1 

-20.4 

1.5  1 

-21 . 2 

2 . 8 

NS 

1 . 4 

-19. 9 

1.3  ! 

-20.8 

2.6 

NS 

2.0 

-19.2 

1.6  ' 

-20 . 3 

2.3 

NS 

2 . 8 

1 -18.5 

1.7  ! 

-20.1 

2 . 2 

.05 

4.0 

-16.8 

2.0 

-19.1 

2.9 

.05 

5 . 7 

: -14.7 

} 

3.2  1 

-17.3 

3 . 4 

. 01 

8.0 

i -12.5 
1 

4.7  ! 

-16.0 

4.1 

.05 

11 

-1^.1 

5.7  j 

-16.5 

3.9 

.05 

16 

: -16.3 

j 

5.8  ■ 

-18.9 

4.0 

NS 

22 

1 -21.5 

6.0 

• -21.6 

3.6 

NS 

b.  Phase  Shift 

{ Degrees ) 

0.19 

1 -2 

10  I 

' 72 

23 

.001 

0.  5 

1 1 

10 

1 28 

. 001 

1 . 0 

' -1 

12  1 

8 

10 

.05 

1.4 

-2 

, 13  ; 

r 1 

13 

NS 

2 . 0 

-7 

15  -8 

15 

NS 

2 . 8 

-14 

18 

1 -19 

17 

.05 

4 . 0 

i -25 

18 

-34 

18 

.05 

5.7 

' -51 

24 

-59 

17 

NS 

8 . 0 

-95 

23 

-105 

17 

.05 

11 

-159 

15 

-166 

16 

.01 

16 

-244 

15 

, -249 

12 

NS 

22 

-335 

1 16 

-352 

12 

.05 

0 dB  represents  1 pound  control  force  per  degree  roll  error 
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Table  B-4 

Effect  of  Motion  Cues  on  Pilot  Describing  Function, 

Disturbance  Input 


Frequency 
( rad/sec) 

static 

Mean  j Std  Dev 

Motion 

Mean  Std  Dev 

Signi f icance 
Level 

a.  Amplitude  Ratio  (dB) 

0.  19 

-15.4 

1 . 5 

-7.6 

4.2 

.05 

0. 5 

-15.9 

1 . 8 

-8.3 

3 . 5 

.05 

1 . 0 

-15.5 

2 . 1 

1-8.3 

3.1 

. 01 

1 . 4 

-15.1 

2.1 

! -7.8 

3 . 1 

.01 

2.0 

! -14.6 

2 . 3 

t -7.9 

j 

3.6 

.05 

2 . 8 

! -13.6 

2.  3 

' -8.0 

3 . 6 

.05 

4.0 

1 -11.3 

2 . 1 

-7.0 

3.3 

. 05 

5.7 

-7.3 

2 . 8 

-5.3 

NS 

o 

00 

-0 . 1 

4.5 

-2.3 

2 . 6 

NS 

11 

- 

2.0 

2 . 4 

NS 

b.  Phase  Shift 

(Degrees ) 

0.19 

i -5 

5 

: -4 
1 

10 

NS 

0.5 

1 -3 

9 

1 

13 

NS 

1 . 0 

i -2 

10 

7 

13 

.05 

1 . 4 

' -1 

10 

, 10 

12 

.05 

2 . 0 

-2 

11 

15 

10 

. 01 

2 . 8 

-6 

11 

' 21 

7 

. 001 

4 . 0 

-11 

13 

34 

7 

.001 

5.  7 

-34 

23 

45 

4 

.001 

o 

00 

-85 

33 

52 

3 

.001 

L_  11 

- 

- 

49 

5 

. 001 

0 dB  represents  1 pound  control  force  per  degree  roll  error 
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Table  B-5 

Effect  of  Motion  Cues  on  Remnant  Ratio 


Frequency 

1 Static 

Motion 

( rad/sec) 

I Mean  | Std  Dev 

Mean  1 Std  Dev 

a Target  Input 


0.19 

-17 . 9 

1 . 5 

-12.0 

2 . 5 

0.5 

-17.1 

2.9 

-15.2 

2.0 

1.0 

-12.7 

1 . 3 

-12.0 

2 . 3 

1.4 

-11.2 

0.7 

-9.3 

2.0 

2.0 

-8.4 

1.9 

-6.0 

2.0 

2.8 

-5.3 

1.7 

-2 . 8 

2 . 3 

4 . 0 

-3.6 

1 . 4 

0.2 

2-8 

5.7 

-1.0 

2.1 

2.8 

3.9 

8.0 

0 . 4 

2 . 0 

4.1 

3.0 

11 

3.6 

2.4 

6.8 

3.1 

16 

6.6 

2.6 

9.3 

2.4 

22 

12.5 

2 . 3 

13.8 

1.2 

b.  Disturbance  Input 


0.19 

-29.5 

3.1 

-31.5 

2.5 

0.5 

-21 . 7 

2 . 2 

-26.4 

3.5 

1 . 0 

-15.1 

2.0 

-19.0 

3.2 

1.4 

-11 . 8 

2.3 

-16.4 

3.2 

2.0 

-8.6 

2.1 

-12.5 

2.9 

2.8 

-4 , 6 

1 . 5 

-8.2 

3.3 

4.0 

-0.5 

1.5 

-3.8 

2.8 

5.7 

4 . 4 

1.3 

0.5 

2 . 8 

8.0 

8.3 

0.5 

3.5 

2 . 3 

11 

1 

- 

- 

7.3 

1.8 

Remnant  ratios  in  dB  (dimensionless  ratio) 
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APPENDIX  C 


► 


MODEL  FORMULATION 

Certain  details  related  to  applying  the  optimal-control 
pilot/vehicle  model  are  described  in  this  Appendix.  Results 
of  the  model  analysis  are  discussed  in  Section  4.2 

C.1  System  Dynamics 


Equations  of  motion  describing  vehicle,  input  and  sensor 
dynamical  response  characteristics  are  described  below. 


C.1.1  Target-Following  Task 


The  system  dynamics  relating  plant  output  (roll  angle) 
to  control  input  were: 


P (s)  ^ 10  _ _5_  _ 20 

U(s)  s s+5*s+20 


The  (analytic)  input  signal  assumed  for  this  task  was 


11 


{ s] 


2 . 0 
(s+1)^ 


2 


W 


(C-2) 


where  W is  a white  noise  process  having  a variance  equal  to  the 

2 

variance  of  the  tracking  input  (100  deg  in  this  experiment). 

The  input  was  assumed  to  be  differenced  from  the  plant  output  to 
produce  the  tracking  error,  and  this  error  was  assumed  displayed 
to  the  pilot  after  a delay  of  0,095  seconds  to  account  for 
recording  and  simulation  lags.  The  delay  was  approximated  by 
the  following  first-order  Pade  network: 


67 


E 


-s  + 21.1 
s + 21.1 


(C-3) 


E ' 


where  E'  is  the  underlayed  error,  E is  the  error  as  displayed  to 
the  pilot. 


The  following  equations  for  state  and  output  variables 
were  used  in  the  model  analysis: 


xl 

x2 

x3 

x4 

x5 

x6 

yi 

y2 

y3 

y4 

y5 

y6 

y7 

where : 
xl 
x2 
x3 
x4 
x5 
x6 


-2.0  xl-1.0  x2+2.0  w 

1.0  xl 

- 5.0x3+  50u 
20  x3  - 20  x4 

1.0  x4 

1.0  xl-21.2  X2-1.0  X4+21.1  x5-21.1  x6 

1.0  x6 

1.0  xl  -21.1  x2  - 1 . 0 x4  +21.1  x5  -21.1  x6 

1.0  x5 

1.0  x4 

20  x3  - 20  x4 
-5.0  x3  + 50  u 

- 500  x3  + 400  x4  + 1000  u 

input  rate 
input 

internal  state 
plant  rate 
plant  position 
tracking  error 
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error 


yl  = tracking 
y2  = tracking  error  rate 
y3  = plant  position 
y4  = plant  rate 
y5  = plant  acceleration 

y6  = approximation  to  plant  acceleration 
yl  = plant  acceleration  rate 

The  approximate  acceleration  variable  y6  was  defined  in 
order  to  provide  a model  variable  to  correspond  to  the  approximate 
measure  of  acceleration  used  experimentally  to  compute  per- 
formance cost.  (See  Appendix  A.)  The  cost  functional  used  in 
obtaining  model  solutions  was 

J = 1.0  a^,  + 0.05  + 1.00  u (C-4) 

yl  y6 

The  coefficient  0.05  operating  on  y6  was  selected  to  match  the 
experimental  data,  and  the  coefficient  1.00  operating  on  control- 
rate  variance  was  the  value  that  yielded  a "motor  time  constant" 
of  0.1  seconds . 


C . 1 . 2 Disturbance-Regulation  Task 


The  re 
was  identical 
input  assumed 


4^ . . 

(s) 

1 1 

where,  for 

th 

a variance 

of 

lationship  between  plant  output  and  control 
to  that  shown  in  Equation  (C-1) . The  track 
for  this  task  was 

5.657  2 

= j W 

(s+2) 

is  task,  W represents  a white  noise  process 
196  (deg/sec) ^ . 


input 

ing 


(C-5) 

having 


The  tracking  input  was  added  to  the  pilot's  control  input 
(the  latter  having  been  scaled  by  a factor  of  10) ; the  computa- 
tional delay  associated  with  visual  presentation  of  tracking 
error  was  approximated  by  the  Fade  network  of  Equation  (C-3) . 

The  following  state  and  output  equations  resulted: 

xl  = -4.0  xl  - 4.0  x2  + 5.657  w 
x2  = 1.0  xl 

x3  = 5.0  x2  - 5.0  x3  + 50  u 
x4  = 20  x3-20  x4 
x5  = 1.0  x4 

x6  = - 1.0  x4  + 21.1  x5  - 21.1  x6 


y 1 = 1.0  x6 

y2  = - 1.0  x4  + 21.1  x5  - 21.1  x6 

y3  = - 20  x3  + 62.2  x4  - 445  x5  + 445  x6 

y4  = 1.0  x5 

y5  = 1.0  x4 

y6  = 20  x3  - 20  x4 

y7  = 5.0  x2  - 5.0  x3  + 50  u 

y8  = 100  x2  - 500  x3  + 400  x4  + 1000  u 


where  the  state  variables  are  as  defined  above  for  the  target- 
following task,  and  the  display  variables  are 


yl  = tracking  error 

y2  = tracking  error  rate 

y3  = tracking  error  acceleration 

y4  = plant  position 

y5  = plant  rate 
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y6  = plant  acceleration 

y7  = approximation  to  plant  acceleration 
y8  = plant  acceleration  rate. 


The  following  models  were  adopted  for  the  semicircular 
canals  and  otolith  motion  sensors: 


Y = 188 ( ■ 02s  + 1) 

s (18s  + 1)  (30s  + 1) 


(C-5) 


Y 

o 


91. 1 (s  + .0988) 
(s  + 0.2) 


SF 


(C-6) 


where  SF  is  the  specific  force.  As  discussed  in  Section  4.2.4, 
SF  may  be  approximated  for  these  experiments  as 


SF  = i - 0. 09  3 <t' 


(C-7) 


The  subject  was  assumed  to  perceive  the  sensor  outputs  y^  and  y^ , 
as  well  as  the  derivatives  of  these  variables.  These  vestibular 
dynamics  were  incorporated  in  the  overall  system  model  by 
expanding  the  state  and  display  equations  as  follows: 

x7  = 1.0  x8 

x8  = 20  x3  - 20  x4  - 0.00185  x7  - 0.089  x8 

x9  = - 0.372  x3  + 0.372  x4  + 0.20  x5  - 0.2  x9 

y9  = 0.139  x3  - 0.139  x4  - .129xl0~^  x7  + 3.74  x8 


yl0=  0.696 

x2 

+ 4.0  x3  - 4.70 

x4  - 6.92x10 

x7 

- 0 

.0333  x8  + 6.96 

u 

yll=  - 169 

x3 

+ 169  x4  + 91.4 

x5  - 46.1  x9 

yl2=  - 846 

x2 

+ 4247  x3  -3310 

x4  - 9.22  x5 

+ 9.22  x9  -8460  u 

71 


where  x7  - x9  are  states  related  to  motion  sensor  dynamics, 
and 

y9  = output  of  semicircular  canal  sensor 

ylO  = rate  of  change  of  output  of  semicircular  canal  sensor 

yll  = output  of  otolith  sensor 

yl2  = rate  of  change  of  output  of  otolith  sensor 
C . 2 Display  Analysis 

Resolution  limitations  of  perception  are  accounted  for  in 
the  pilot/vehicle  model  through  appropriate  adjustment  of  observa- 
tion noise  levels.  An  effective  perceptual  "threshold"  is 
determined  for  each  displayed  variable;  the  smaller  the  pre- 
dicted rms  level  of  a given  quantity,  the  greater  the  variance 
of  the  associated  observation  noise  process.  Additional  details 
on  treatment  of  perceptual  thresholds  may  be  found  in  [13]. 

Effective  thresholds  for  the  model  analysis  performed  in 
this  study  were  computed  on  the  basis  of  the  following  assumptions 

1.  Thresholds  are  determined  by  the  subject's  ability 
to  perceive  displacement  and  rate  of  the  tip  of  the 
rotating  error  bar. 

2.  On  the  basis  of  previous  studies  [11],  effective 
perceptual  thresholds  for  displacement  and  rate 
are  approximately  0.05  degrees  visual  arc  and 
0.2  degrees/second  visual  arc,  respectively. 
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In  order  to  relate  degrees  visual  arc  as  seen  by  the 
pilot  to  degrees  of  rotation  of  the  error  bar,  the  following 


measurements  are  needed: 


L = 0.625  inches 


D = 20  inches 

where  L is  the  length  of  the  error  bar  from  center  to  tip  and 
D is  the  distance  from  the  subject's  eye  to  the  display. 

We  define  the  following  variables: 

S = displacement  of  the  tip  of  the  error  bar  in  inches 
= angle  of  displacement  of  the  error  bar,  degrees 
a = displacement  of  the  tip  of  the  error  bar  in  degrees 
visual  arc 

and  note  the  following  relationships: 
tan  u = S/D 

(C-l 

tan  0 = S/L 

If  we  assume  angles  small  enough  so  that  the  tangent  of 
the  angle  is  appro,ximately  equal  to  the  angle  (in  radians)  , the 
following  relationship  applies: 


= £ a = 32  ri 


Thus,  in  terms  of  problem  units,  effective  perceptual  thresholds 
are  1,6  degrees  and  6.4  degrees/second. 


73 


Model  analysis  was  initially  performed  using  these  values 
for  perceptual  thresholds.  A closer  match  to  experimental 
data  was  obtained,  however,  by  ignoring  the  displacement 
threshold  and  reducing  the  rate  threshold  by  half. 

It  should  be  noted  that  the  values  initially  assumed 
for  perceptual  thresholds  are  based  on  studies  in  which  the 
subjects'  visual  task  was  to  estimate  the  translation  of  the 
error  bar  from  a zero-reference  bar.  Different  perceptual 
processes  may  have  been  involved  in  this  study,  as  the  subjects 
were  required  to  detect  rotation  of  the  error  bar.  Additional 
laboratory  studies  would  seem  to  be  in  order  to  determine  more 
precisely  the  effective  thresholds  that  correspond  to  perception 
of  rotational  displacement  and  velocity  in  manual  control  tasks. 
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